Conferencing system, server, image display method, and computer program product

ABSTRACT

The conferencing system is composed of computers, a moderator&#39;s computer, and a projector connected on a network. The moderator&#39;s computer receives image data from the computers, and generates synthesized image data therefrom, which is transmitted to the projector for display of the synthesized image. The moderator&#39;s computer has the capability to switch the image being projected by the projector from the synthesized image to an image handled by one of the computers or by the moderator&#39;s computer. With such an arrangement, utilizing existing hardware resources it will be possible to display in a single split-screen display the images handled by the terminals connected on the network. Additionally, it will be possible to switch smoothly between on-screen displays, and to reduce the burden on the on-screen display operator in a networked conferencing system.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 12/186,620 filed Aug. 6, 2008, which claims priority fromJapanese Patent Application No. 2007-205647, filed Aug. 7, 2007, whichis hereby incorporated by reference in its entirety.

BACKGROUND

1. Field of the Invention

The present invention relates to a conferencing system which includes aterminal, a server, and an image display device connected via aprescribed communication channel.

2. Description of the Related Art

Conferencing systems in which multiple PCs are hooked up to a projectorhave been developed in recent years. Such a conferencing system enablesdisplay screens of the multiple computers to be projected simultaneouslythrough a split-screen display; this is useful in situations such asconferences or seminars where it is desired to carry out a discussionwhile visually comparing data stored on several different computers.Known technologies relating to such conferencing systems includes thatdisclosed in JP-A-2004-54134 for example.

The above Patent Cited Reference discloses a technology whereby screencapture images from a number of terminals connected on a network arecombined by a projector and projected as a single split-screen display.

However, conferencing systems employing this kind of the projectorrequire the use of a special projector, so if a user who already owns aconventional projector wishes to participate in such a conferencingsystem, this will require the purchase of a new special projector, atconsiderable expense to the user. Moreover, in cases where a user who isoperating the projector wishes to modify the currently projectedsplit-screen display, for example, in order to toggle one of theterminal screens shown in the split-screen display to the screen ofanother terminal which is not currently displayed, there can beconsiderable wait time until the projector creates and projects the newcombined image. Additionally, in instances where a user who is operatingthe projector wishes to himself present an image for projection by theprojector, it will be necessary to operate two devices, namely theprojector plus a terminal, thus imposing a considerable operationalburden on the user. These problems are not limited to conferencingsystems that employ projectors, and are common generally to conferencingsystems in which on-screen displays of terminals are shown on displaydevices of various kinds.

With the foregoing in view, it is one object of the present invention toprovide a conferencing system that, utilizing existing hardwareresources, is able to display in a single split-screen display imagesthat are handled by terminals connected by a prescribed communicationchannel. It is another object to provide a conferencing system able toswitch smoothly between on-screen displays. It is a further object toreduce the burden on the operator entailed by on-screen display in aconferencing system that employs a prescribed communication channel.

SUMMARY

The present invention is addressed to attaining the above and/oroptional objects at least in part according to the following modes. Anaspect of the conferencing system having a terminal, a server, and animage display device connected via a prescribed communication channel,

wherein the terminal includes a first transmission unit that transmitsto the server, via the prescribed communication channel, terminal imagedata representing an image handled by the terminal;

the server includes: a reception unit that receives the terminal imagedata transmitted from the terminal, an image synthesis unit thatgenerates synthesized image data for the purpose of displaying asynthesized image which has been created by synthesizing the imagerepresented by the received terminal image data with another image, and

a second transmission unit that transmits the synthesized image data sogenerated as data for display to the image display device via theprescribed communication channel; and

the image display device includes a display unit for receiving the datafor display and displaying the data as an image

In the conferencing system of the above design, the server generatessynthesized image data for the purpose of displaying a synthesized imagecreated by synthesizing an image represented by terminal image datareceived with another image, and transmits the synthesized image data tothe image display device. Consequently, the image display device will beable to display a synthesized image simply by receiving and displayingthe synthesized image data, thus making it possible for an existingimage display device lacking any special split-screen displayfunctionality to display images handled by terminals connected on aprescribed communication channel, in the form of single split-screendisplay. The expression “prescribed communication channel” is usedherein in a broad sense to include not only various types of networkssuch as local area networks, wide area networks, the Internet and so on,but also communications units of various kinds, such as communicationsunits having direct local connections between devices rather thannetwork connections.

Besides the embodiment as a conferencing system described above, thepresent invention may also be embodied as a server for displaying imageson an image processing device; an image display method for display ofimages by a computer; or a computer program for displaying images. Thecomputer program may be recorded on a computer-readable storage medium.Recording media that can be used for this purpose include flexibledisks, CD-ROM, DVD-ROM, magnetooptical disks, memory cards, hard disks,and other media.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an illustration of a configuration of a conferencing system10;

FIG. 2 is an illustration of a general configuration of computersPC1-PC5;

FIG. 3 is an illustration of a general configuration of a moderator'scomputer PCm;

FIG. 4 is an illustration of a general configuration of a projector PR1;

FIG. 5 is a flowchart depicting, in the connection process of thecomputers PC1-PC5 and the moderator's computer PCm, the flow on thecomputer PC1-PC5 side;

FIG. 6 is a flowchart depicting, in the connection process of thecomputers PC1-PC5 and the moderator's computer PCm, the flow on themoderator's computer PCm side;

FIG. 7 is an illustration depicting a specific example of an hourlyprofile 33;

FIG. 8A is an illustration depicting a specific example of an hourlyprofile 83;

FIG. 8B is an illustration depicting a specific example of a classmakeup profile 84;

FIG. 9 is an illustration depicting by way of an embodiment an exampleof a flow of a split-screen display switching process for switchingon-screen display using the conferencing system 10;

FIG. 10 is an illustration depicting by way of an embodiment anexemplary flow of a split-screen display switching process for switchingon-screen display using the conferencing system 10;

FIG. 11 is an illustration depicting an exemplary Projector Selectionwindow W400 for making projector and on-screen display settings;

FIG. 12 is an illustration depicting an exemplary Projector Operationwindow W500 for carrying out projector operation;

FIG. 13 is an illustration depicting an example display shown during useof the Projector Operation window W500;

FIG. 14 is an illustration depicting by way of an alternative embodimentan exemplary flow of a split-screen display switching process forswitching on-screen display using the conferencing system 10;

FIG. 15 is an illustration depicting by way of an alternative embodimentan exemplary flow of a split-screen display switching process forswitching on-screen display using the conferencing system 10; and

FIG. 16 is an illustration depicting an exemplary Projector Operationwindow W500 in an alternative embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The embodiments of the present invention will now be described.

A. Configuration of Conferencing System 10

A-1. General System Configuration:

A configuration for a conferencing system 10 according to thisembodiment is depicted in FIG. 1. This conferencing system 10 is animage display system capable of simultaneous displaying by means of aprojector an on-screen display of multiple terminals; the systemincludes computers PC1 through PC5, a moderator's computer PCm, and aprojector PR1 which are connected on a prescribed communication channel.In this embodiment, the computers PC1 through PC5, the moderator'scomputer PCm, and the projector PR1 are connected on a local areanetwork LAN. While not shown in the drawing, other devices equivalent tothe moderator's computer PCm and the projector PR1 are installed on thelocal area network LAN as well.

The method of connection of the computers PC1 through PC5, themoderator's computer PCm, and the projector PR1 is not limited to themode described above, and various other connection methods could be setup depending on the work environment, required communication speed, andother considerations. For example, there could be a local connection,such as a D-sub cable or USB cable connection, between the moderator'scomputer PCm and the projector PR1. Connections are not limited to wiredconnections, and wireless connections may be employed as well.Naturally, connections via the Internet would be possible as well.

While leaving a more detailed discussion for later, the projector PR1 iscapable of displaying through projection onto a screen SC1 a synthesizedimage that has been created by the moderator's computer PCm synthesizingfour different images into a single screen image. Herein, the four areasof the split-screen display on the screen SC1 will be denoted assplit-screen areas SC11 through SC14, as shown in the drawings.

A-2. General Configuration of Computers PC1-PC5:

The computer PC1 in the conferencing system 10 is a personal computer onwhich prescribed programs have been installed, and is provided for useby a certain Student A. The general configuration of the computer PC1 isdepicted in FIG. 2. Computers PC2 to PC5 which have been provided foruse by Students B to E are comparable in configuration to the computerPC1 and as such need not be discussed here. As illustrated, the computerPC1 includes a CPU 20, a hard disk drive 30, a ROM 36, a RAM 38, anetwork interface 41, an input system 51, a VRAM 61, a graphicscontroller 63, and a display 65, which are respectively interconnectedvia a bus.

The CPU 20 performs control of the computer PC1 by loading into RAM 38firmware or an OS which is stored on the hard disk drive 30 or in theROM 36, and then executing it. Also, through execution of programsstored on the hard disk drive 30 the CPU 20 can function as a datatransmission module 21 or as a communications module 22. These functionmodules will be discussed in detail later.

The hard disk drive 30 contains memory areas set aside for storing, inaddition to the IP address of the computer PC1, an address/server namemanagement table 31, a server name profile 32, and an hourly profile 83.These elements will be discussed in detail later. These memory areas arenot limited to being provided on the hard disk drive 30, and may insteadbe set aside in EEPROM, a type of rewritable nonvolatile memory.

The network interface 41 constitutes the interface for connection to thelocal area network LAN; the computer PC1 is connected to the local areanetwork LAN via this network interface 41.

The input system 51 includes a keyboard and a pointing device (a mousein this example). The graphics controller 63, using the VRAM 61 as abuffer, displays images intended to be shown on the display 65.

A-3. General Configuration of Moderator's Computer PCm:

The moderator's computer PCm in the conferencing system 10 is a personalcomputer on which prescribed programs have been installed, and isprovided for use by an Instructor M. In the embodiment, this moderator'scomputer PCm corresponds to the element of the server in the claims. Thegeneral configuration of the moderator's computer PCm is depicted inFIG. 3. As illustrated, the moderator's computer PCm includes a CPU 70,a hard disk drive 80, a ROM 86, a RAM 88, a network interface 91, a USBinterface 93, an input system 101, a VRAM 111, a graphics controller113, and a display 115, which are respectively interconnected via a bus.

Through execution of programs stored on the hard disk drive 80, the CPU70 can function as a data communications control module 71, an imagesynthesis module 72, a synthesized image reception module 73, an imagetoggling reception module 74, GUI control module 75, a communicationsmodule 76, a transmission instruction reception module 77, and acompleted synthesis alert module 78. These function modules will bediscussed in detail later. The transmission instruction reception module77 and the completed synthesis alert module 78 are function modulesprovided in an alternative embodiment, described later.

The hard disk drive 80 contains memory areas set aside for storing, inaddition to the IP address of the moderator's computer PCm, anaddress/client name management table 81, a client name profile 82, anhourly profile 83, and a class makeup profile 84. These elements will bediscussed in detail later. A number of GUI programs, discussed later,are stored as well. These will be discussed in detail later. Thesememory areas are not limited to being provided on the hard disk drive80, and may instead be set aside in EEPROM, a type of rewritablenonvolatile memory.

The USB interface 93 is a USB compliant interface for connection to theprojector PR1, and the moderator's computer PCm is connectable to theprojector PR1 with a USB cable.

The ROM 86, the RAM 88, the network interface 91, the input system 101,the VRAM 111, the graphics controller 113, and the display 115 aresimilar in design to those of the computers PC1-PC5, and need not bedescribed in detail.

A-4. General Configuration of Projector PR1;

The projector PR1 in the conferencing system 10 is a conventionalprojector lacking any special split-screen display capability; itsgeneral configuration is depicted in FIG. 4. As illustrated, theprojector PR1 includes a CPU 120, a ROM 136, a RAM 138, a networkinterface 141, a USB interface 143, a VRAM 151, a graphics controller153, and a projection section 155, which are respectively interconnectedvia a bus.

By loading a program stored in the ROM 136 into the RAM 38 and executingit, the CPU 120 can function as a data reception module 121. Thisfunction module will be discussed in detail later.

The network interface 141 is an interface for connection to the localarea network LAN; the projector PR1 is connected to local area networkLAN through this network interface 141. The USB interface 143 is aUSB-compliant interface for connection to the moderator's computer PCm,and the projector PR1 is connectable to the moderator's computer PCmwith a USB cable.

Using the VRAM 151 as a buffer, the graphics controller 153 controls theprojection section 155 to project images. The projection section 155 isan LCD projection system that displays images on the screen SC1 byprojecting light that has passed through liquid crystal panels for eachof the RGB color components. While LCD technology is employed in thisembodiment, no particular limitation to this technology is impliedthereby, and it would be possible to use other technologies such as aCRT, DLP, LCOS, or GLV technology.

B. Method of Using Conferencing System 10

The following specific discussion of the method of use of theconferencing system 10 envisions a conferencing system 10 adapted foruse in a classroom. In the example below, it is assumed that in thecourse of the lesson the Instructor M in his or her capacity as thefacilitator of the lesson will control the moderator's computer PCm, andvia the projector PR1 will display on the screen SC1 in full-screendisplay any of the on-screen display images PCT1-PCT5 shown on thedisplay 65 of each of the computers PCT1-PCT5 being used by the StudentsA-E, or the on-screen display image PCTm shown on the display 115 of themoderator's computer PCm; or a split-screen display that shows selectedon-screen display images from among the on-screen display imagesPCT1-PTC5 and PCTm. The on-screen display images PCT1-PTC5 and PCTm areimages that show data created respectively by the Students A-E and theInstructor M; depending on the circumstances of the lesson, the StudentsA-E and the Instructor M may take turns explaining the data they haveindividually created.

B-1. Initial Setup for Use:

Initial setup for the purpose of using the conferencing system 10 willnow be described. Here, initial setup refers to the initial setup forthe purpose of communication among the computers PC1-PC5 and themoderator's computer PCm. The initial setup process is initiated when,first, the Instructor M launches a prescribed software application, andeach Student A-E then launches the prescribed software application.

Once the aforementioned software application has started up, the CPU 20of each of the computers PC1-PC5 will issue a search command for globalbroadcast onto the local area network LAN. Meanwhile, the CPU 70 of themoderator's computer PCm having received the search command will replyto each of the computers PC1-PC5 with the computer name (instructorname) and IP address of the moderator's computer PCm. The computersPC1-PC5, upon receipt of the computer name and IP address, will registerthe information in the address/server name management table 31.

The CPU 20 of each of the computers PC1-PC5 will then individuallytransmit the computer name (student name) and IP address of its computerPC1-PC5 to the moderator's computer PCm. Upon receipt of these computernames and IP addresses, the moderator's computer PCm will register themin the address/client name management table 81.

Subsequently, through lookup in the server name profile 32 in which isregistered the instructor's name and lookup in the aforementionedaddress/server name management table 31, the computers PC1-PC5 willidentify the IP address of the moderator's computer PCm and establishcommunication. Similarly, through lookup in the client name profile 82and in the address/client name management table 81, the moderator'scomputer PCm will identify the IP addresses of the computers PC1-PC5 andestablish communication. In this embodiment, this initial setup processis designed to be carried out each time that aforementioned softwareapplication is launched in order to deal with instances in which a newstudent has been added or an IP address has changed; however, it ispossible to dispense with this updating of initial setup in instanceswhere there has been no change in registration over a prescribed timeperiod. The initial setup process described above may also be designedto be input by the Instructor M and the Students A-E using the inputsystems 51 and 101.

In this embodiment, it has been assumed that the IP addresses of thecomputers PC1-PC5 and the moderator's computer PCm have been saved onthe respective hard disk drives of the computers by being set beforehandby the Students A-E and the Instructor M; however, no particularlimitation to such a mode is intended. For example, it would beacceptable, prior to the initial setup described above, for a DHCPserver on the local area network LAN to receive IP address requestsglobally broadcast by the computers PC1-PC5 and by the moderator'scomputer PCm, and to individually assign IP addresses.

B-2. Connection Process:

FIG. 5 and FIG. 6 depict the flow of the process establishingconnections among the computers PC1-PC5 and the moderator's computerPCm. FIG. 5 depicts the process carried out on the computer PC1-PC5 sideby the CPU 20 through a process in its capacity as the communicationsmodule 22. FIG. 6 depicts the process carried out on the moderator'scomputer PCm side by the CPU 70 through a process in its capacity as thecommunications module 76. The description below assumes that theStudents A-E have been assigned computers for their own exclusive use.These processes will be initiated upon launch of the aforementionedsoftware application and completion of initial setup.

When the connection process is initiated, first the CPU 20 of each ofthe computers PC1-PC5 will load the hourly profile 33 stored on the harddisk drive 30, as depicted in FIG. 5 (Step S200).

A specific example of the hourly profile 33 is depicted in FIG. 7. Thehourly profile 33 is a profile that establishes access points on ahourly basis; in this case, lesson time slots for first period to fourthperiod Monday through Friday are associated with names of theinstructors of the lessons taking place in those lesson time slots. Thatis, the hourly profile 33 represents a lesson schedule for the StudentsA-E, specifying for example that first period on Mondays will be taughtby Instructor M, and that third period on Tuesdays will be taught byInstructor N. This hourly profile 33 will have been input beforehand byeach Student A-E using the input system 51, and stored on the hard disk30.

Once the hourly profile 33 has been loaded, the CPU 20 will compare thecurrent time with the hourly profile 33 and decide whether there is anyprofile data corresponding to the current time (Step S201).

As a result, if there is corresponding profile data (Step S201: YES),this will mean that lesson attendance has been scheduled for the time inquestion, and the CPU 20 will accordingly request a connection to thecomputer (in this embodiment, the moderator's computer PCm) of theinstructor in question (in this embodiment, Instructor M), at the timein question (Step S202). While not shown in FIG. 1, if like InstructorM, Instructors N to Q shown in FIG. 7 also have individually assignedmoderator's computers that are connected to the local area network LAN,and if there are times at which other lessons have been scheduled,requests will be made to connect to the computers of Instructors N to Q.On the other hand, if there is no corresponding profile data (Step S201:NO), this will mean that no lesson has been scheduled for the time inquestion, and the process will terminate.

Meanwhile, when the connection process is initiated on the moderator'scomputer PCm end, first, as depicted in FIG. 6 the CPU 70 will load thehourly profile 83 and the class makeup profile 84 stored on the harddisk drive 80, as depicted in FIG. 6 (Step S221).

A specific example of this hourly profile 83 is depicted in FIG. 8A. Thehourly profile 83 is a profile that establishes access points on ahourly basis; in this case, lesson time slots for first period to fourthperiod Monday through Friday are associated with the names of thelessons to be taught in those lesson time slots. That is, the hourlyprofile 83 represents a teaching schedule for Instructor M, specifyingfor example that he or she will teach Class 1 during first period onMondays, and will teach Class 2 during second period on Mondays.

A specific example of the class makeup profile 84 is depicted in FIG.8B. The class makeup profile 84 is a profile indicating the makeup ofclasses on an individual lecture attendance basis; here, the names ofthe students making up the class in question have been associatedrespectively with Class 1 to Class 7.

This hourly profile 83 and the class makeup profile 84 will have beeninput beforehand by Instructor M, and stored on the hard disk drive 80.

Once the hourly profile 83 and the class makeup profile 84 have beenloaded, the CPU 70 will decide on an ongoing basis whether connectionrequests have been made by the Students A-E, i.e. by the computersPC1-PC5 (Step S222).

As a result, if no connection request has been made (Step S222: NO), itwill await a connection request. If on the other hand it is decided thata connection request has been made (Step S222: YES), the CPU 70 willrefer to the hourly profile 83 and to the class makeup profile 84 inorder to decide whether the student making the connection request is astudent belonging to the class that corresponds to the current timespecified in the hourly profile 83 (Step S223).

As a result, if the student belongs to the class (Step S223: YES), theCPU 70 will allow connection in response to the connection request fromthe student, and a connection will be set up (Step S224). If on theother hand the student does not belong to the class, since the studentin question is not authorized to attend the lesson being held at thistime, the CPU 70 will refuse the connection request from the student(Step S225), whereupon the process will return to the aforementionedStep S222 and await a new connection request from a student. In thisway, connections between the computers PC1-PC5 and the moderator'scomputer PCm are set up via the local area network LAN.

While this embodiment assumes that Students A-E have each been assignedthe computers PC1-PC5 for their own exclusive use, in instances where asingle computer will be shared by more than one student, it would bepossible to employ an arrangement whereby, prior to the aforementionedStep S200, the CPU 20 will prompt the student to enter his or her name,and in the aforementioned Step S202 will transmit the student's name,together with the connection request, to the moderator's computer PCm.

Moreover, whereas in this embodiment both the computers PC1-PC5 in theircapacity as terminals, and the moderator's computer PCm in its capacityas the server, respectively store profiles that contain associationsbetween temporal conditions and access points, it would also beacceptable to employ an arrangement in which such profiles are storedonly by one or the other. Where profiles are stored only by themoderator's computer PCm, by employing an arrangement whereby thecomputers PC1-PC5 automatically globally broadcast connection requestsonto the local area network LAN, the moderator's computer PCm will beable to look up in the hourly profile 83 and the class makeup profile84, and allow connections only for the computers PC1-PC5 that matchthese profiles, thereby making it possible for connections between thecomputers PC1-PC5 and the moderator's computer PCm to be set upautomatically.

Further, it would be acceptable to employ an arrangement whereby if themoderator's computer PCm refuses a connection in Step S225, the computerPC1-PC5 that was refused the connection will be notified of the refusedconnection. By so doing, the Student A-E may rapidly be apprised that heor she is not authorized to attend the lesson in question.

B-3. Split-screen Display Switching Process:

FIG. 9 and FIG. 10 depict an exemplary flow of a split-screen displayswitching process in which the conferencing system 10 of the embodimentis used to project the on-screen displays of the computers PC1-PC5 ontothe screen SC1 as a split-screen display image while switching among theon-screen displays. The right column in FIG. 9 and FIG. 10 depictsoperations performed by the Instructor M using the moderator's computerPCm, to specify on-screen displays for projection onto the screen SC1.The middle columns in FIG. 9 and FIG. 10 depict processes of themoderator's computer PCm in response to the operations performed by theInstructor M shown in the right column, and processes of the computersPC1-PC5 and in the projector PR1 in response to the processes of themoderator's computer PCm. The left columns in FIG. 9 and FIG. 10 depictthe images projected onto the screen at each stage of the processesshown in the middle columns.

This process will be initiated through a projected image instructionoperation performed by the Instructor M on the moderator's computer PCm.In this embodiment, the instruction operation is one instructing theprojector PR1 to project on-screen display images PCT1-PCT4 of thecomputers PC1-PC4, in the form of four split-screen images (OperationO360).

Operation O360 is specified using the input system 101, and a GUI(graphical user interface) that is displayed on the display 115 of themoderator's computer PCm. A specific example of the GUI is describedbelow. On the moderator's computer PCm, when the aforementioned softwareapplication is launched, the CPU 70 will use the graphics controller 113to bring up on the display 115 a window for selecting the projector andfor making on-screen display settings. FIG. 11 depicts a ProjectorSelection window W400 as an example of such a window. The ProjectorSelection window W400 includes a projector selection sub-window 410 andan on-screen display settings sub-window W420.

The projector selection sub-window 410 displays a list of the projectorsconnected to the moderator's computer PCm. The projectors displayed hereare projectors whose connection to the moderator's computer PCm havebeen recognized automatically through plug-and-play. FIG. 11 depicts theprojector PR1 selected as the projector for use from among the connectedprojectors PR1 and PR2. While not shown in FIG. 1, for the purposes ofthis example the projector PR2 is assumed to be connected on the localarea network LAN through a configuration similar to the projector PR1.If a projector is located on the local area network LAN, theaforementioned list of projectors in the projector selection sub-window410 will show the results of a search by the CPU 70 for projectors whenthe software application is launched; however, by clicking on a Searchbutton B412 it will be possible to search again for connectedprojectors.

The on-screen display settings sub-window W420 shows display options forimages to be displayed on the screen SC1 by the projector PR1. In theexample of FIG. 11, the options are full screen display, two-screendisplay, and four-screen display; of these, the four-screen displayoption is depicted as having been selected. Two-screen display andfour-screen display represent display options whereby different imageswill be displayed simultaneously in split-screen display. By selectingfrom among these display modes it is a simple matter to switch betweensplit-screen display and full-screen display; a detailed discussion willfollow later. The options for split-screen display are not limited totwo-screen display and four-screen display shown here by way of example;naturally, a three-screen display, or a display of five or more screens,would be acceptable as well. An arrangement that further enablesselection of various split-screen display modes during 2-screen display,such as the placement of split screens (i.e. whether the two screenswill be displayed arrayed horizontally or the two screens will bedisplayed arrayed vertically) or the sizing of individual split screens,would be acceptable as well.

Once the projector PR1 and the four-screen display have been selected inthe above manner and an OK button B422 has been clicked, the CPU 70,through a process in its capacity as the GUI control module 75, willload from among a number of GUI programs stored on the hard disk drive80 the GUI program that corresponds to the selected four-screen display,and using the graphics controller 113 will bring up a projectoroperation window on the display 115. FIG. 12 depicts a ProjectorOperation window W500 as one example of such a window. The ProjectorOperation window W500 includes a moderator indicator sub-window W510, aparticipant indicator sub-window W520, a Projector Operation sub-windowW600, and a Preview sub-window W700.

The moderator indicator sub-window W510 shows as the moderator's namethe name of the predetermined user of the moderator's computer PCm.Where the moderator's computer PCm is shared among multiple users, themoderator may be prompted to input his or her name at launch of thesoftware application.

The participant indicator sub-window W520 shows a list of computersenabled for projection by the projector PR1, as well as the status ofeach of these. A projection-enabled computer refers to a computer withwhich a connection with the moderator's computer PCm was set up in theaforementioned Step S224 and the moderator's computer PCm. In thesub-window W520, the computers are designated by the name of the user ofthe computer in question, for convenience in identification. Statusrefers to information indicating whether a computer is currently beingprojected. In the example in FIG. 12, the moderator indicator sub-windowW510 displays the moderator name “Instructor M” and the participantindicator sub-window W520 displays “Student A-E” using computersPC1-PC5. As it is sufficient for the displays of the moderator indicatorsub-window W510 and the participant indicator sub-window W520 touniquely identify the moderator and the participants, computer names ormodels etc. could be displayed instead.

The Projector Operation sub-window W600 includes an upper left screensub-window W610, an upper right screen sub-window W620, a lower rightscreen sub-window W630, and a lower left screen sub-window W640. Thereason that four screen sub-windows are provided here is that“four-screen display” was selected from the on-screen display settingssub-window W420 discussed previously; if “two-screen display” had beenselected, the number of screen sub-windows would be two, and if“full-screen display” had been selected, the number of screensub-windows would be one. That is, the number and placement of thescreen sub-windows provided in the Projector Operation sub-window W600will correspond to the split-screen display shown on the screen SC1. Inthis embodiment, screen sub-windows are associated with a specificnumber of divided areas and placement thereof within the split-screendisplay; however, no particular limitation is imposed thereby andsub-windows may instead be associated with various other split-screendisplay modes. For example, where individual split screen constituentareas making up a split-screen display are shown with screen borders ofdifferent colors, the colors of the corresponding screen sub-windowscould be associated with the colors of these borders; or whereindividual split screen constituent areas differ from one another inshape or size, the shape or size of the corresponding screen sub-windowscould be associated with the shape or size of these split screenconstituent areas.

The upper left screen sub-window W610 includes a projector userindicator field D611; a Project button B613; a Quit button B614; and aFull Screen Display button B615. The projector user indicator field D611is field that indicates the user of the computer that corresponds to theimage for display in the upper left split-screen display area (the splitscreen constituent area SC11). The Project button B613 and the Quitbutton B614 are control buttons used to start and stop projecting aprescribed image in the upper left split-screen display area,independently of other split-screen display areas. For example, with“Student A” selected in the participant indicator sub-window W520 asdepicted in FIG. 12, by clicking the Project button B613 in the upperleft screen sub-window W610, “Student A” can be shown in the projectoruser indicator field D611, and the on-screen display image PCT1 of thecomputer PC1 being used by Student A can be displayed in the upper leftscreen area on the screen SC1, namely, the split screen constituent areaSC11. By then clicking the Quit button B614, the “Student A” indicationwill disappear from the projector user indicator field D611, and thescreen display image PCT1 will disappear from the split screenconstituent area SC11. In another possible arrangement, the operation ofselecting “Student A” from the participant indicator sub-window W520 andassigning the screen display image PCT1 to the split screen constituentarea SC11 from the Projector Operation sub-window W600 may beaccomplished by dragging and dropping “Student A” into W610 in theparticipant indicator sub-window W520, rather than clicking on theProject button B613.

The Full Screen Display button B615 is a button used to toggle betweenthe four-screen split-screen display and the full-screen display. Forexample, if the four-screen split-screen display is currently beingdisplayed on the screen SC1, clicking the Full Screen Display buttonB615 will toggle the image displayed in the upper left split screen areato full-screen display. Clicking the Full Screen Display button B615again will toggle back from full-screen display to the originalfour-screen split-screen display. Since the upper right screen windowsW620-W640 are similar to the upper left screen window 610, they will notbe discussed here.

The Projector Operation sub-window W600 includes a PLAY button B601, aSTOP button B602, and a PAUSE button B603 for controlling projectionoperation of the projector PR1. These buttons are used to performcollective operations on images transmitted to the projector PR1 by themoderator's computer PCm, and they permit images projected by theprojector PR1 to be played, stopped, or paused through collectiveoperations, regardless of whether the display on the screen SC1 iscurrently a split-screen display or a full-screen display.

The Preview sub-window W700 is an area that, when any of the StudentsA-E displayed in the participant indicator sub-window W520 have beenselected, provides a preview of the on-screen display image PCT1-PCT5that corresponds to the selected student, irrespective of the imageprojected by the projector PR1; it is possible to enlarge or shrink thedisplay using an Enlarge button B701 or a Shrink button B702 providedfor this purpose. The preview function may employ, for example, imagedata of reduced data size that was received from the computers PC1-PC5by the moderator's computer PCm sending data transmission requests tothe computers PC1-PC5 when the Students A-E are selected from theparticipant indicator sub-window W520.

The Projector Operation window W500 provided with these sub-windowsfurther includes a Select Projector button B501 and a Configurationbutton B502. The Select Projector button B501 is a button for selectinga projector and for resetting the on-screen display; clicking thisbutton will bring up the Projector Selection window W400 discussedearlier. Accordingly, by clicking the Select Projector button B501 tobring up the Projector Selection window W400 it will be possible for theInstructor M to select a projector or to modify the on-screen displaysettings even while the conferencing system 10 is currently in use. TheConfiguration button B502 is a button for configuring settings such aswhether to use the input history to the projector PR1.

Once the Projector Selection window W400 has been brought up by clickingthe Select Projector button B501 and the on-screen display settings havebeen changed in the manner discussed above, the subsequently displayedProjector Operation window W500 will change to reflect these changes.For example, if from the Projector Selection window W400 an operation isperformed to switch from four-screen display to two-screen display, theCPU 70 through a process in its capacity as the GUI control module 75will load from among the GUI programs stored on the hard disk drive 80the GUI program that corresponds to two-screen display, and will displaythe Projector Operation window W500 that now includes a ProjectorOperation sub-window W600 composed of two screen sub-windows. Where, thescreen sub-windows have been associated with the display modes ofsplit-screen display color, shape, or size as mentioned above, theProjector Operation sub-window W600 may be modified to reflect thechanges in display mode.

In another possible arrangement, the screen sub-windows W610-W640 thatmake up the Projector Operation sub-window W600 display thumbnails thatthe CPU 70 has created on the basis of image data for display in thecorresponding split-screen display area and stored in the RAM 88. Forexample, the screen sub-windows W610-W640 may be provided with displayfields for displaying the thumbnails, at locations that will notinterfere with the buttons etc.; or semitransparent thumbnails createdby dimming the luminance signal may be displayed superposed over thebuttons etc. This will make it easier to ascertain relationships betweensplit-screen display areas and the screen sub-windows W610-W640,affording simpler operation.

The discussion now returns to Operation O360. Using the GUI describedabove, the Instructor M selects “Student A” from the participantindicator sub-window W520, and after confirming the content of theon-screen display image PCT1 displayed in the Preview sub-window W700,clicks the Project button B613 of the upper left screen sub-window W610.In similar fashion, once Students B-D have been selected and the contentof the on-screen display images PCT2-4 displayed in the Previewsub-window W700 has been confirmed, the instructor will click theProject button B623-B643 in each of the corresponding upper right screensub-windows W620-W640. The purpose of this operation is to instructprojection of the screen display images PCT1-PCT4 of the computersPC1-PC4 in a four-screen split-screen display by the projector PR1.These instructions will be handled by the CPU 70 through a process inits capacity as the synthesized image reception module 73.

Once the split-screen display command has been received, the CPU 70 ofthe moderator's computer PCm will send a sequence of data transmissionrequests to the computers PC1-PC4 (Step S300).

Meanwhile, upon receipt of the data transmission request sent by themoderator's computer PCm (Step S320), the CPU 20 of each of thecomputers PC1-PC4, through a process in its capacity as the datatransmission module 21, will transmit to the moderator's computer PCmimage data of the on-screen display image PCT1-PCT4 displayed on itsindividual display 65 (Step S321). This image data of the on-screendisplay images PCT1-PCT4 represents image data (here, RGB image data)that was saved in the RAM 61 of the computer PC1-PC4 at the time thatthe data transmission request was received, and will be transmittedtogether with settings information for the graphics controller 63necessary for the image data to be displayed in image form. Settingsinformation for the graphics controller 63 need not be transmitted ifthe graphics controller 63 of each of the computers PC1-PC4, thegraphics controller 113 of the moderator's computer PCm, and thegraphics controller 153 of the projector PR1 have standardized settings.

Meanwhile, upon receipt of transmissions from the computers PC1-PC4, theCPU 70 of the moderator's computer PCm through a process in its capacityas the data communications control module 71 will receive the image dataof the on-screen display images PCT1-PCT4 respectively transmitted bythe computers PC1-PC4, and save it in the RAM 85 in association with thename of the computer (Step S301). Through a process in its capacity asthe image synthesis module 72 the CPU 70 will then generate in the RAM85 synthesized image data representing a synthesized image of theon-screen display images PCT1-PCT4 (Step S302).

Once the synthesized image data has been generated, through a process inits capacity as the data communications control module 71 the CPU 70will transmit the synthesized image data of the on-screen display imagesPCT1-PCT4 to the projector PR1 (Step S304).

In the projector PR1 meanwhile, through a process in its capacity as thedata reception module 121 the CPU 120 will receive the synthesized imagedata of the on-screen display images PCT1-PCT4, and record it to theVRAM 151. The graphics controller 153 will then read the image data fromthe VRAM 151 and will project the image onto the screen SC1 using theprojection section 155 (Step S340). Thus, as depicted in the left columnin FIG. 9, a four-screen split-screen showing the respective on-screendisplay images PCT1-PCT4 will be displayed on the screen SC1.

At this time, the Projector Operation window W500 discussed above willassume a condition like that depicted in FIG. 13. As illustrated, in theparticipant indicator sub-window W520, “Currently projecting” status isshown for the Students A-D. In the Projector Operation sub-window W600,“Students A-D” are respectively shown in the projector user indicatorfields D611-D641. In the Preview sub-window W700, the on-screen displayimage PCT4 which corresponds to the last-selected Student D is shown inthe participant indicator sub-window W520.

In the aforementioned Step S302 and Step S304, the synthesized imagedata was transmitted after the CPU 70 has received image data from allof the computers PC1-PCT4 and had generated the synthesized image data;however, generation and transmission of the synthesized image data maytake place at prescribed timing intervals as well. In the formerinstance, the four-screen split-screen display image will appearsuddenly on the screen SC1; whereas in the latter instance, the imageswill be displayed progressively in the course of generating thefour-screen split-screen display.

Next, in order to provide a more detailed explanation to the Student Aregarding the on-screen display image PCT1, the Instructor M willoperate the input system 101 to instruct toggling of the image projectedonto the screen SC1 from the four-screen split-screen display image ofthe on-screen display images PCT1-PCT4 to a full-screen display of theon-screen display image PCT1 of the computer PC1 (Operation O361).Specifically, from the Projector Operation window W500 displayed on thedisplay 115 of the moderator's computer PCm, the Instructor M will clickon the Full Screen Display button B615 of the upper left screensub-window W610.

Upon receiving this instruction, in the moderator's computer PCm,through a process in its capacity as the image toggling reception module74 the CPU 70 will receive the instruction; and through a process in itscapacity as the data communications control module 71 will transmit theimage data of the on-screen display image PCT1 recorded in the RAM 85 inassociation with the name of the computer PC1 to the projector PR1 (StepS305).

In the projector PR1 meanwhile, the CPU 120 through a process in itscapacity as the data reception module 121 will receive the image data ofthe on-screen display image PCT1 sent by the moderator's computer PCm,and in the same manner as in Step S340 discussed previously, willproject the image onto the screen SC1 (Step S341). By so doing, asdepicted in the left column of FIG. 9, the on-screen display image PCT1will be displayed in full-screen display on the screen SC1. By so doing,it will be possible for example for the Student A who is using thecomputer PC1 to show to the other students the on-screen display imagePCT1 which is now displayed prominently on the screen SC1, while at thesame time explaining the on-screen display image PCT1 in detail whileverifying the content on the display 65 of the computer PCT1.

Next, the Instructor M will project the on-screen display image PCT1 infull-screen display onto the screen SC1, and while the Student A isexplaining the on-screen display image PCT1, will control the inputsystem 101 to instruct creation of synthesized image data in which, ofthe synthesized image data of the screen display images PCT1-PCT4, theon-screen display image PCT5 is interchanged with the on-screen displayimage PCT2 (Operation O362). Specifically, in the Projector Operationwindow W500 displayed on the display 115 of the moderator's computerPCm, the Instructor M will click on the Quit button B624 of the upperright screen sub-window W620 that corresponds to the split-screendisplay area of the on-screen display image PCT2; and then from theparticipant indicator sub-window W520 will select “Student E” and clickon the Project button B823 of the upper right screen sub-window W620.This operation is in preparation for split-screen display of theon-screen display images PCT1, 5, 3, and 4 after explanation of theon-screen display image PCT1 has been completed.

Upon receiving this instruction, the CPU 70 of the moderator's computerPCm, through a process in its capacity as the synthesized imagereception module 73, will receive the instruction, and through lookup inthe client name profile 82 and the hourly profile 83 will identify theIP address of the other device, and send a data transmission request tothe computer PC5 (Step S306).

Meanwhile, upon receipt of the data transmission request sent by themoderator's computer PCm (Step S322), the CPU 20 of the computer PC5through a process in its capacity as the data transmission module 21will transmit the image data of the on-screen display image PCT5currently displayed on the display 65 to the moderator's computer PCm(Step S323). In consideration of the communications load on the localarea network LAN, transmission of this image data in Step S323 and StepS321 may take place in a compressed format such as JPEG.

Meanwhile, upon receipt of the transmission from the computer PC5,through a process in its capacity as the data communications controlmodule 71 the CPU 70 of the moderator's computer PCm will receive theimage data of the on-screen display image PCT5 sent by the computer PC5,and will save it to the RAM 85 in association with the computer name(Step S307). Through a process in its capacity as the image synthesismodule 72, the CPU 70 will generate from the image data of the on-screendisplay images PCT1, 5, 3, and 4 that was saved in the RAM 85synthesized image data that represents a synthesized image of theon-screen display images PCT1, 5, 3, and 4, and will record this data tothe RAM 85 (Step S308).

Then, once the Student A has finished explaining the on-screen displayimage PCT1, the Instructor M will control the input system 101 toinstruct toggling of the image being projected onto the screen SC1, fromfull-screen display of the on-screen display image PCT to split-screendisplay (Operation O363). Specifically, from the Projector Operationwindow W500 displayed on the display 115 of the moderator's computerPCm, the Instructor M will click on the Full Screen Display button B615of the upper left screen sub-window W610.

Upon receiving this instruction, the CPU 70 of the moderator's computerPCm, through a process in its capacity as the image toggling receptionmodule 74, will receive the instruction, and then through a process inits capacity as the data communications control module 71 will send tothe projector PR1 the synthesized image data of the on-screen displayimages PCT1, 5, 3, 4 that was recorded in the RAM 85 (Step S310).

Meanwhile, in the projector PR1, through a process in its capacity asthe data reception module 121 the CPU 120 will receive the synthesizedimage data of the on-screen display images PCT1, 5, 3, 4, and in thesame manner as in the aforementioned Step S340 and Step S341 willproject the image onto the screen SC1 (Step S342). By so doing, asdepicted in the left column in FIG. 10, a four-screen split-screenshowing the respective on-screen display images PCT1, 5, 3, and 4 willbe displayed in the split-screen areas SC11-SC14. This completes thescreen toggling process of the embodiment.

In this embodiment, in response to a data transmission request from themoderator's computer PCm, the computers PC1-PC5 will send to themoderator's computer PCm image data recorded in the VRAM 61 at the timethat the transmission request was received; however, no limitation tosuch an arrangement is intended. For example, the computers PC1-PC5could instead at periodic intervals transmit image data recorded in theVRAM 61 to the moderator's computer PCm. Alternatively, data could betransmitted to the moderator's computer PCm each time that data in theVRAM 61 is updated. With such an arrangement, by updating the imagebeing displayed on the screen SC1 to the most recent image by the methodshown in the embodiment each time that the moderator's computer PCmreceives the image data, it will be possible for on-screen displayimages PCT1-PCT5 reflecting changes in the on-screen display imagesPCT1-PCT5 to be shown on the screen SC1, even where the on-screendisplay image PCT1-PCT5 on any of the computers PC1-PC5 has changed, orwhere the on-screen display image PCT1-PCT5 is a moving image. Wheresuch an arrangement is employed, it will be possible to reduce thetraffic load on the local area network LAN by having the computersPC1-PC5 transmit only the updated portion of the data.

While this embodiment has shown an example in which the on-screendisplay images PCT1-PCT5 are projected onto the screen SC1, it wouldalso be possible to project the on-screen display image PCTm of themoderator's computer PCm through selection by the Instructor M from theparticipant indicator sub-window W520 of the Projector Operation windowW500. In this case, the Instructor M will minimize the ProjectorOperation window W500 once the desired image data is shown on thedisplay 115.

In this embodiment, the on-screen display images PCT1-PCT5 of thecomputers PC1-PC5 constitute the images for projection onto the screenSC1, but no limitation is intended thereby and it would be acceptable todisplay any other image handled by the computers PC1-PC5. For example,if the computers PC1-PC5 are equipped with webcams, images taken therebycould be projected. Alternatively, it would be possible to project anyspecified image from among image data stored on the computers, ratherthan the current display on the display 65 of each of the computersPC1-PC5.

In this embodiment, a projector was described by way of the imagedisplay device included in the conferencing system 10, but various othertypes of display devices, such as a plasma display, liquid crystaldisplay, organic EL display or the like could be used as well. Also,while by way of example the computers PC1-PC5 were described as theterminals included in the conferencing system 10, the terminals could becomposed of various other kinds of communications terminals such asmobile phones, PDAs (Personal Digital Assistant), and so on.

In this embodiment, the moderator's computer PCm functioned as theserver for receiving image data from the computers PC1-PC5, generatingsynthesized images, transmitting these the projector PR1 and so on;however, the moderator's computer PCm operated by the Instructor M andthe server may be provided as separate devices. This can reduce the loadon the moderator's computer PCm, and enhance the usage capabilities ofthe moderator's computer PCm. In such a case, the hourly profiles savedon the hard disks 30 of the computers PC1-PC5, as well as the hourlyprofile 83 and the class makeup profile 84 stored on the hard disk 80 ofthe moderator's computer PCm, may be managed by the server instead. Thiswill enable the schedules of the Instructor M and the Students A-E, themakeup of each class, and so on to be managed in an integrated fashion,making management easier.

Using image data of images handled by the computers PC1-PC5 and receivedby the moderator's computer PCm from the computers PC1-PC5, as well asimage data of images handled by the moderator's computer PCm, theconferencing system 10 of the above configuration generates synthesizedimage data and transmits the data to the projector PR1. Consequently,the projector PR1 can display a synthesized image simply by displayingthe synthesized image data it has received. That is, utilizing anexisting projector PR1 that lacks any special split-screen displayfunctionality, it is possible for images handled by the computersPC1-PC5 and by the moderator's computer PCm which are connected on thelocal area network LAN to be displayed as a single split-screen display.Additionally, through simple operation using the moderator's computerPCm, the operator of the moderator's computer PCm will be able todisplay desired images from his or her own computer as well, without theneed to operate a separate terminal.

The conferencing system 10 can switch the image data transmitted to theprojector PR1 by the data communications control module 71 of themoderator's computer PCm between synthesized image data, and image datahandled by any of the computers PC1-PC5 or by the moderator's computerPCm. Consequently, users will be able to conference while displaying asynthesized image, an image handled by any of the computers PC1-PC5, oran image handled by the moderator's computer PCm, as conditions warrant.

During the time that any of the on-screen display images PCT1-PCT5 orPCTm are being projected in full-screen display on the screen SC1, theconferencing system 10 of the above configuration can generate desiredsynthesized images through operation of the moderator's computer PCm,and once generation of the image is finished can toggle the display onthe screen SC1 from full-screen display to split-screen display in orderto display the image of the synthesized image data thusly created;accordingly, during switching between screens, it will be possible toavoid unnecessary wait time for the synthesized image data to begenerated and displayed, so the discussion can continue uninterrupted.The conference may therefore proceed smoothly.

C. Alternative Embodiment

An alternative embodiment of the present invention will now bedescribed. A point of difference from the preceding embodiment is thatthe moderator's computer PCm is provided with a unit for receiving aninstruction to transmit image data to the projector PR1, and a unit foralerting the user of the moderator's computer PCm when generation of thesynthesized image is done. This difference will be discussed in detailbelow.

FIG. 14 and FIG. 15 are illustrations depicting exemplary flow of asplit-screen display toggling process in the alternative embodiment. InFIG. 14 and FIG. 15, process steps comparable to those in the embodimenthave been assigned the same symbols as in the embodiment, and are notdiscussed in any detail. This process will be initiated when theInstructor M instructs the moderator's computer PCm to generatesynthesized image data that represents the on-screen display imagesPCT1-PCT4 of the computers PC1-PC4 as a four-screen split-screen displayimage (Operation O380). While the Operation O360 in the embodiment wasan operation for instructing both generation and transmission ofsynthesized image data, this operation differs from the Operation O360in that it instruct only generation of the synthesized image data.

The above Operation O380 is carried out through a method comparable tothe Operation O360 in the embodiment. However, the GUI employed in thisalternative embodiment has a few differences from that in the previousembodiment. A specific example of the Projector Operation window W500employed in the alternative embodiment is depicted in FIG. 16. A pointof difference from the embodiment is that the Projector Operationsub-window W600 included in the Projector Operation window W500 has aSend button B605 and a completed image synthesis indicator field D607.These will be discussed in detail later.

When an instruction to generate synthesized image data is received, theCPU 70 will receive image data from the computers PC1-PC4, and willgenerate synthesized image data of the on-screen display imagesPCT1-PCT4 (Steps S300-S302, S320, 321). When generation of thesynthesized image data is finished, through a process in its capacity asthe completed synthesis alert module 78 the CPU 70 will alert the userof the moderator's computer PCm, i.e. the Instructor M, when generationof the synthesized image data is done (Step S303). Specifically, themessage “Image Synthesis Done” will appear in the completed imagesynthesis indicator field D607, for example.

Having ascertained through the aforementioned Step S303 that generationof the synthesized image data is finished, the Instructor M will now usethe input system 101 to click on the Send button B605 and instruct thatthe synthesized image data so generated be sent to the projector PR1(O381).

Upon receiving this Send instruction, through a process in its capacityas the transmission instruction reception module 77 the CPU 70 of themoderator's computer PCm will transmit the generated synthesized imagedata to the projector PR1 for display of the on-screen display imagesPCT1-PCT4 in four-screen split-screen display (Steps S304, S340).

In other words, a significant difference of these processes from thoseof the embodiment is that no image data will be transmitted to theprojector PR1 until the CPU 70 in its capacity as the transmissioninstruction reception module 77 receives the Send instruction.

Next, the Instructor M will instruct the moderator's computer PCm tocreate, from the synthesized image data of the on-screen display imagesPCT1-PCT4, synthesized image data in which the on-screen display imagePCT2 is replaced by the on-screen display image PCT5 (Operation O382).Upon receiving this instruction, the CPU 70 of the moderator's computerPCm will receive the image data of the on-screen display image PCT5 fromthe computer PC5, and generate synthesized image data representing asynthesized image of the on-screen display images PCT1, 5, 3, and 4(Steps S306-S308, S322, S323).

Once generation of the synthesized image data is finished, through aprocess in its capacity as the completed synthesis alert module 78, theCPU 70 will alert the user of the moderator's computer PCm, i.e. theInstructor M, of the fact that generation of the synthesized image datais done (Step S309). As in the aforementioned Step S303, the completedimage synthesis indicator field D607 can be used as the specific methodof alert.

Having ascertained through the aforementioned Step S309 that generationof the synthesized image data is finished, the Instructor M will now usethe input system 101 to click on the Send button B605 and instruct thatthe synthesized image data so generated be sent to the projector PR1(O383).

Upon receiving this Send instruction, through a process in its capacityas the transmission instruction reception module 77, the CPU 70 of themoderator's computer PCm will transmit the generated synthesized imagedata to the projector PR1 for display of the on-screen display imagesPCT1, 5, 3, and 4 in four-screen split-screen display (Steps S310,S342).

In this embodiment, the completed image synthesis indicator field D607of the Projector Operation sub-window W600 is employed as the unit bywhich the CPU 70 notifies the Instructor M when generation ofsynthesized image data is done; however, no limitation to thisparticular mode is intended. For example, the CPU 70 could instead lookup in the RAM 88 and display the generation conditions of thesynthesized image data in the Preview sub-window W700. With such a modeas this as well, the Instructor M can be apprised when generation of thesynthesized image data is done.

In the conferencing system 10 having the above configuration, themoderator's computer PCm will transmit display data only upon receivingan instruction to transmit image data to the projector PR1.Consequently, synthesized image data representing a new split-screendisplay (e.g. on-screen display images PCT1, 5, 3, 4) can be generatedthrough a process separate from the previous display, while theprojector PR1 is still displaying the previous prescribed split-screendisplay (e.g. in-screen display images PCT1-PCT4). Then, aftergeneration of the new display is finished, once an instruction to sendthe synthesized image data to the projector PR1 is received, whentoggling from the previous prescribed split-screen display to the newsplit-screen display it will be possible to avoid unnecessary wait timebefore the synthesized image data is generated and displayed. Suchadvantages will be particularly significant in cases where the newsplit-screen display contains a large number of split screens; wheresome time is needed to generate the synthesized image data owing to thelarge size of the image data for display; or where factors such astraffic conditions on the local area network LAN result in slowcommunication speeds between the moderator's computer PCm and thecomputers PC1-PC5.

In the conferencing system 10 having the above configuration, since themoderator's computer PCm alerts the user of the moderator's computer PCmwhen generation of the synthesized image data is finished, the user ofthe moderator's computer PCm can switch the display image after beingapprised that generation of the synthesized image data is finished.Consequently, when switching between display images, it will be possibleto make this switch while accurately estimating the timing in such a wayas to avoid unnecessary wait time to generate and display the imagedata.

While the present invention has been described herein through certainpreferred embodiments, it is to be understood that the present inventionis in no way limited thereby and can be reduced to practice in othermodes without departing from the spirit and scope of the invention. Forexample, besides the conferencing system set forth above, the inventioncan be worked in other modes such as a server, an image display method,a computer program, or a recording medium.

Several such other modes of working the invention will be describedbelow. One such mode is a conferencing system as set forth above,wherein the terminals are composed of a plurality of terminals; thereception unit receives terminal image data from at least two of theplurality of terminals; and the other image includes an imagerepresented by at least one set of image data from among the receivedterminal image data from at least two terminals.

With a conferencing system having this configuration, since theterminals are composed of multiple terminals, and the reception unitreceives respective terminal image data from at least two terminalsamong the plurality of terminals, images handled by the plurality ofterminals can be displayed in a single split-screen display.

Alternatively, the other image may include an image handled by theserver. In a conferencing system having this configuration, an imagehandled by a terminal and an images handled by the server can bedisplayed a single split-screen display. Consequently, through simpleoperation using the server, the user of the server will be able todisplay a desired image from his or her own computer as well, withoutthe need to operate a separate terminal.

Furthermore, in another possible configuration for the conferencingsystem, the second transmission unit may include a switching unit thatswitches the transmitted data for display from the synthesized imagedata to the terminal image data received by the reception unit, or toserver image data representing an image handled by the server.

With a conferencing system having this configuration, since the secondtransmission unit includes a switching unit for switching thetransmitted display data from the synthesized image data to the terminalimage data or to server image data, users can conference whiledisplaying either a synthesized image, a terminal image, or a serverimage as conditions warrant.

The server may further include a first reception unit that receives aninstruction to switch the data for display; and the second transmissionunit may switch the data for display on the basis of an instructionreceived by the first reception unit.

With a conferencing system having this configuration, the serverreceives an instruction to switch the data for display, and switched thedata for display depending on this instruction. Consequently, the usercan toggle among displayed images as conditions of the conferencewarrant, and the conference can proceed smoothly and in a highlyflexible manner.

In such a conferencing system, the image synthesis unit may generate newsynthesized image data when the second transmission unit has switchedthe data for display from the synthesized image data to the terminalimage data or to the server image data.

With a conferencing system having this configuration, new synthesizedimage data will be generated when the data for display has been switchedfrom synthesized image data to terminal image data or to server imagedata. Consequently, during the time that the image display device isdisplaying the terminal image or the server image, new synthesized imagedata can be generated; and once generation thereof is finished, by thenswitching the data for display to the new synthesized image anddisplaying the new synthesized image, it will be possible to avoidunnecessary wait time for generating and displaying the synthesizedimage data when the display image is switched.

Alternatively, the server may further include a second reception unitthat receives an instruction to transmit the data for display to theimage display device; and the second transmission unit may transmit thedata for display on the basis of an instruction received by the secondreception unit.

With a conferencing system having this configuration, the serverreceives an instruction to transmit data for display to an image displaydevice, and transmits the data for display on the basis of thisinstruction. Consequently, during the time that prescribed synthesizedimage data is being transmitted to image display device as data fordisplay and the synthesized image is being displayed on the imagedisplay device, new synthesized image data can be generated; and oncegeneration thereof is finished, by then issuing an instruction totransmit the new synthesized image data to the image display device asdata for display, it will be possible to avoid unnecessary wait time forgenerating and displaying the synthesized image data when the displayimage is switched.

Furthermore, the server may further include a unit that alerts the userof the server when generation of the synthesized image data by thesynthesis unit is complete.

With a conferencing system having this configuration, the user of theserver will be alerted that generation of the synthesized image data bythe synthesis unit is finished, and thus the user of the server will beable to switch the displayed image upon confirming that generation ofthe synthesized image data is finished. Consequently, when switchingbetween display images, it will be possible to make the switch whileaccurately estimating the timing in such a way as to avoid unnecessarywait time to generate and display the image data.

Additionally, in this conferencing system, the server may furtherinclude a third reception unit that receives an instruction to specifyimages for making up a synthesized image; and the image synthesis unitmay generate the synthesized image data on the basis of an instructionreceived by the third reception unit.

With a conferencing system having this configuration, the serverreceives an instruction to specify images for inclusion in thesynthesized image, and on the basis of the instruction generatessynthesized image data. Consequently, the user can toggle amongdisplayed images as conditions of the conference warrant, and theconference can proceed smoothly and in a highly flexible manner.

The image handled by the terminal may be an image that is displayed on adisplay screen provided to the terminal. With a conferencing systemhaving this configuration, since an image displayed on the displayscreen provided to the terminal can be displayed, the user of a terminalcan explain displayed content on the image display device whileverifying the display screen of the terminal in question.

The present invention shall in no wise be construed as limited to theembodiments and modes set forth herein, and the scope of the inventionshall be determined by the appended claims and core technologicalfeatures of the invention.

What is claimed is:
 1. A server comprising: a first reception unit thatreceives first terminal image data transmitted from a first terminalthat includes a first display screen and receives second terminal imagedata transmitted from a second terminal that includes a second displayscreen, the first terminal image data representing an image that isdisplayed on the first display screen and the second terminal image datarepresenting an image that is displayed on the second display screen; animage synthesis unit that generates synthesized image data bysynthesizing together the first terminal image data and the secondterminal image data, the synthesized image data including a first areaand a second area; a controller that displays an operation window thatincludes a first operation area corresponding to the first area and asecond operation area corresponding to the second area; a secondreception unit that receives a first instruction to allocate the firstterminal image data to one of the first operation area and the secondoperation area, and receives a second instruction to allocate the secondterminal image data to the other of the first operation area and thesecond operation area; and a transmission unit that selectivelytransmits one of the synthesized image data, the first terminal imagedata, and the second terminal image data to a projector that receivesthe one of the synthesized image data, the first terminal image data,and the second terminal image data and displays an image based on theone of the synthesized image data, the first terminal image data, andthe second terminal image data.
 2. The server in accordance with claim1, wherein the synthesized image data further includes an image handledby the server.
 3. The server in accordance with claim 1, wherein thesecond reception unit further receives a third instruction to switchwhich of the synthesized image data, the first terminal image data, andthe second terminal image data is selectively transmitted by thetransmission unit.
 4. The server in accordance with claim 1, wherein theimage synthesis unit further generates new synthesized split-screenimage data when data for display by the projector has been switched fromthe synthesized image data to full-screen image data including the firstterminal image data or the second terminal image data.
 5. The server inaccordance with claim 1, wherein the transmission unit receives aninstruction to transmit data for display to the projector; and transmitsthe data for display on the basis of the instruction.
 6. The server inaccordance with claim 1, wherein the image synthesis unit alerts a userof the server when generation of the synthesized split-screen image databy the image synthesis function is complete.
 7. The server in accordancewith claim 1, wherein the second reception unit receives a fourthinstruction to specify images for inclusion in the synthesizedsplit-screen image; the image synthesis unit generates the synthesizedsplit-screen image data on the basis of the instruction received by thethird reception unit.
 8. The server in accordance with claim 1, whereinthe second reception unit further receives a fifth instruction to selectone of full screen display, two-screen display, and four-screen displayfor display by the projector.
 9. The server in accordance with claim 1,wherein a layout of the first operation area and the second operationarea in the operation window corresponds to a layout of the first areaand the second area in the synthesized image data.
 10. A non-transitorycomputer-readable storage medium storing a computer program comprising:a first program code for executing a first reception function thatreceives first terminal image data transmitted from a first terminalthat includes a first display screen and receives second terminal imagedata transmitted from a second terminal that includes a second displayscreen, the first terminal image data representing an image that isdisplayed on the first display screen and the second terminal image datarepresenting an image that is displayed on the second display screen; asecond program code for executing an image synthesis function thatgenerates synthesized image data by synthesizing together the firstterminal image data and the second terminal image data, the synthesizedimage data including a first area and a second area; a third programcode for executing an operation function that displays an operationwindow that includes a first operation area corresponding to the firstarea and a second operation area corresponding to the second area; afourth program code for executing a second reception function thatreceives a first instruction to allocate the first terminal image datato one of the first operation area and the second operation area, andreceives a second instruction to allocate the second terminal image datato the other of the first operation area and the second operation area;and a fifth program code for executing a transmission function thatselectively transmits one of the synthesized image data, the firstterminal image data, and the second terminal image data to a projectorthat receives the one of the synthesized image data, the first terminalimage data, and the second terminal image data and displays an imagebased on the one of the synthesized image data, the first terminal imagedata, and the second terminal image data.
 11. An image display methodcomprising: receiving first terminal image data transmitted from a firstterminal that includes a first display screen, the first terminal imagedata representing an image that is displayed on the first displayscreen; receiving second terminal image data transmitted from a secondterminal that includes a second display screen, the second terminalimage data representing an image that is displayed on the second displayscreen; generating synthesized image data by synthesizing together thefirst terminal image data and the second terminal image data, thesynthesized image data including a first area and a second area;displaying an operation window that includes a first operation areacorresponding to the first area and a second operation areacorresponding to the second area; receiving a first instruction toallocate the first terminal image data to one of the first operationarea and the second operation area; receiving a second instruction toallocate the second terminal image data to the other of the firstoperation area and the second operation area; and selectivelytransmitting one of the synthesized image data, the first terminal imagedata, and the second terminal image data to a projector that receivesthe one of the synthesized image data, the first terminal image data,and the second terminal image data and displays an image based on theone of the synthesized image data, the first terminal image data, andthe second terminal image data.